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Abstract Two distinct mechanisms for filtering noise in an input signal are 
identified in a class of adaptive sensory networks. We find that the high 
frequency noise is filtered by the output degradation process through time- 
averaging; while the low frequency noise is damped by adaptation through 
negative feedback. Both filtering processes themselves introduce intrinsic 
noises, which are found to be unfiltered and can thus amount to a signif- 
icant internal noise floor even without signaling. These results are applied 
to E. coli chemotaxis. We show unambiguously that the molecular mecha- 
nism for the Berg-Purcell time- averaging scheme is the dephosphorylation 
of the response regulator CheY-P, not the receptor adaptation process as 
previously suggested. The high frequency noise due to the stochastic ligand 
binding-unbinding events and the random ligand molecule diffusion is aver- 
aged by the CheY-P dephosphorylation process to a negligible level in E. coli. 
We identify a previously unstudied noise source caused by the random mo- 
tion of the cell in a ligand gradient. We show that this random walk induced 
signal noise has a divergent low frequency component, which is only ren- 
dered finite by the receptor adaptation process. For gradients within the E. 
coli sensing range, this dominant external noise can be comparable to the 
significant intrinsic noise in the system. The dependence of the response and 
its fluctuations on the key time scales of the system are studied systemati- 
cally. We show that the chemotaxis pathway may have evolved to optimize 
gradient sensing, strong response, and noise control in different time scales. 
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1 Introduction and summary 

A main function of biological sensory systems is to detect minute signals in 
fluctuating environments. One key task of the underlying signaling pathways 
(networks) is then to mitigate the effects of external noise. However, the 
network itself can introduce noise due to the finite number of bio-molecules 
involved in the intracellular signaling process. Both the intrinsic stochasticity 
of the signaling networks and the noise in the input can contribute to large 
fluctuations in the output of the system. Therefore, correctly identifying the 
dominant sources of noise and deciphering the cellular strategy in noise filter- 
ing are critical in understanding the proper functioning of biological sensory 
systems. 

In their now classical work [1], Berg & Purcell proposed a time-averaging 
scheme for filtering noise from the stochastic ligand receptor binding process. 
The key idea was that if the noise correlation time is r s , the output variance 
can be reduced by averaging the signal over a longer timescale according 
to a 2 oc T 8 /r( s y There has been much recent progress in rigorous derivations 
of the correlation time r s of the diffusion and binding noise for different 
systems [2-6]. However, the Berg-Purcell expression itself has been given for 
granted, and the molecular origin of the time averaging mechanism remains 
unclear. No connection has been established between r^ s y the dynamics of 
the pathway and its many time scales. Furthermore, often an ad hoc value of 
T( s y usually the longest time scale of the system, is used without justification 
[1,2]. One goal of this paper is to understand and clarify the molecular origin 
of the Berg-Purcell time- averaging mechanism based on rigorous analysis of 
the stochastic dynamics for a class of adaptive sensory systems. 

Most sensory signaling systems, such as bacterial chemotaxis, adapt [7-9] 
through feedback control [10] to maintain a high sensitivity over a wide range 
of backgrounds [11]. A step stimulus (input) triggers a fast change of the 
output (response) followed by a slow recovery (adaptation) to its pre-stimulus 
level. Given adaptation's long timescale and its stabilizing effect, a natural 
question is whether it also serves as a noise filter. More specifically, whether 
the adaptation time serves as the averaging time r^ s y This is indeed assumed 
to be the case by several previous studies, particularly for E. coli chemotaxis 
[4,12]. Here, we show unambiguously that the Berg-Purcell averaging time is 
not the adaptation time. In fact, is the response time that is controlled 
by the signal degradation process. This is the first result of this paper. 

The time- averaging mechanism works well in filtering high frequency 
noise with correlation time shorter than the response time. Indeed, for E. 
coli chemotaxis, the noises due to the stochastic ligand receptor binding- 
unbinding process and the random ligand diffusion, considered by Berg & 
Purcell originally [1] and followed by other more recent studies [1-6], have 
short time scales (~ 10 _5 s for ligand diffusion and ~ 10 _T s for ligand bind- 
ing) and is rendered irrelevant by averaging over a relatively long response 
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time (t( s ) ~ 0.1s). For E. coli chemotaxis the dominant signal fluctuation, 
we find, comes from the random motion of the cell. In a ligand gradient, this 
random motion introduces an unbounded low frequency fluctuation in the 
input signal. Such random walk induced signal noise has not been studied 
before, even in recent works regarding chemotaxis noise in a ligand gradi- 
ent [4]. Here, we show that random walk noise is not filtered by the time- 
averaging mechanism. Instead, this low frequency noise is suppressed by the 
receptor adaptation process by a mechanism general to adaptive networks 
which we call feedback control. The frequency (or time) dependence in the 
filtering function in the case of adaptive control is opposite to that of the 
time-averaging mechanism. This is the second result of this paper. 

However, these intracellular biochemical noise filtering mechanisms, time- 
averaging through output degradation and feedback control through receptor 
adaptation, also introduce fluctuations in the output themselves due to the 
finite number of molecules involved in these processes. Here, we derive the 
expressions of these intrinsic noises from the stochastic pathway dynamics. 
We show that both these intrinsic noises are not filtered (suppressed) by the 
pathway itself and can thus contribute to a significant intrinsic noise floor 
even in the absence of any signal. This is the third result of this paper. 

Finally, we verify these analytical results by simulating the propagation of 
signal noise in the nonlinear E. coli chemotaxis pathway dynamics for bacte- 
rial cells moving in an attract ant gradient. Using biologically relevant param- 
eters, we show that the random- walk induced noise is the main source of sig- 
nal noise, while the ligand diffusion and binding noises are irrelevant. We also 
systematically study the dependence of the response and its fluctuation (due 
to both extrinsic and intrinsic noises) on the two key time scales (response 
time and adaptation time). Form our analysis, we argue that the chemotaxis 
pathway has evolved to optimize gradient sensing, strong response, and noise 
control in different time scales. 



2 Two noise filtering strategies of adaptive signaling networks 

We study noise in a generic three- node adaptive network (Fig. 1A, see [13, 
14]) that abstracts the E. coli chemotaxis pathway (Fig. IB). We will then 
show that the results can be further generalized to other related adaptive 
signaling network topologies shown in Fig. 1C-F. 

In Fig. 1A, the signal s is sensed by the fast "activity" node a, which 
controls the output y. The "memory" m, which depends on a, carries out 
adaptation by feeding back to control the activity a. The noisy dynamics of 
this adaptive network can be described by the Langevin equations: 

... da 

Activity — = /a (a, m, s + rj s ) + r] a ; 

Adaptation — = j m (a, m) + rj m ; 
dy 

Output — = f y (a, y)+r)y- (1) 
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where r] represents different noise sources: r) a , f] m and rj y are the internal 
white noises caused by the stochastic biochemical reactions; the spectrum of 
the signal noise r] s depends on its origin as described later. 

The interactions among the nodes are characterized in Eq. (1) by the 
functions /, whose exact forms can be obtained from the detailed kinetics of 
the system. The network topology (Fig. 1A) constrains these interactions in 
the following way. The feedback mechanism requires f a ,mfm,a < 0; the sta- 
bility of the system requires f a ^ a < 0, f Vj y < and / m , m < 0; and accurate 
adaptation is achieved by choosing / m , m = [15]. With these constrains, 
Eq. 1 generally defines an adaptive system with response rate uj y = \f y , y \ 
and adaptation rate uj m = \ f a ,mfm,a/ fa,a\- Here jX stands for derivative with 
respect to x. Also, for each characteristic frequency uo x we define a charac- 
teristic time as r x = l/co x . 

There are two types of signal related noise. The first is caused by the 
stochasticity of the discrete signal sensing events such as ligand binding- 
unbinding, which was considered originally by Berg and Purcell [1]. This 
ligand binding noise exists even for constant signals. The second signal noise 
is caused by the random temporal variations of the external signal, e. g., air 
pressure fluctuations for ear hair cells, diffusion of ligand around a chemore- 
ceptor, or fluctuations in attract ant concentration sensed by a bacterium 
due to the cell's random motion up an attractant concentration gradient. 
This latter case will be studied in detail in the next section. In general, we 
model the signal noise r] s as exponentially correlated with strength (rjg) and 
correlation time r s . 

For relatively small noise, Eq. 1 can be linearized around its steady state 
and the transfer function for each of the noise sources can be determined 
analytically in frequency (uj) space. For example, for signal noise one has 
5y(u) = xM^sM, where 

xM = iA s ujuj y /[{iuj + u m )(iu + uj y )} (2) 

is the transfer function for small signals, with A s dependent on the inter- 
action functions [13]. The output y in a single cell fluctuates due to both 
external signal noise and intrinsic pathway noise. The strength of the output 
fluctuation can be characterized by its variance, which can be calculated by 
<jy = (27r) -1 f_ (Sy(uj) 2 )duj. Summing up contributions from all the noise 
sources, we obtain a compact expression of the total variance for the output 
V' 

* 2 Y = C s x ^- + C a x ^ + Cm x ^ + C y x 3L- , ( 3 ) 

T(s) r {a) r (m) T {y) 

where each contribution, originating from a separate node in the network, 
has been written in the form of a dimensionless noise amplitude, defined 
as C x = A^(t] 2 }t x /2 with A x the corresponding transfer function ampli- 
tude; multiplying the ratio of the characteristic time of the node r x over a 
node-specific aver aging- time r^) which depends on the key timescales of the 
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system. The times for the signal noise and the internal noises are 

r (s) = (r y + T m )(r y + r s )(r m + r s )/r^; (4) 

^(m) = 7"ra5 

r <2/> = V 

Eq. (3) presents a comprehensive picture of the different sources of noise 
in the system and their contributions to the output variance. The forms of the 
averaging times reveal the underlying mechanisms for filtering different forms 
of noise. From the explicit expression of the signal averaging time (Eq. 
4), two distinct noise filtering mechanisms and their responsible underlying 
biochemical processes are revealed. 

1) Time averaging: For high frequency noise (r s <C T y ,T m ) one has ~ 
r y (l + Ty/r m ) ~ r y . The last approximation is justified since in most adap- 
tive sensory systems the initial response to a signal is much faster than the 
adaptation r y <C r m (examples in [8,9] all substantially more than ten fold). 
Therefore, we have 

cry « C s T s /r y , (5) 

which follows exactly the Berg-Purcell time- aver aging scheme. More impor- 
tantly, through the rigorous derivation of the time- averaging scheme, its un- 
derlying molecular mechanism is revealed. From Eq. 5, the averaging time 
is T y , the response time, which is essentially the decay time of the output. 
Our finding here unambiguously shows that the underlying mechanism for 
averaging high frequency noise is the output degradation process. The slow 
adaptation dynamics does not play any role in time- averaging, contrary to 
what was proposed before [4,12]. For E. Coli, we will see that output degra- 
dation is slow enough as to render irrelevant ligand diffusion and binding 
noise. 

2) Adaptive control: For low frequency noise (r s ^> T mi T y ) one has w 
(1 + r y /r m )/r m « T^/r m , which is no longer an averaging time. Indeed, 

the output variance takes the form 

ay ~ C s r m /r s , (6) 

fundamentally different from the Berg-Purcell scheme. <j y is now inversely 
proportional to r s and proportional to r m : faster adaptation leads to smaller 
output fluctuation. This noise filtering mechanism, which we call adaptive 
noise control, is carried out by the adaptation process and it only applies 
when adaptation is faster than the correlation time of the noise. Later, we 
will show how this mechanism controls the effects of signal noise caused by 
the random walk (run-tumble) motion of E. coli cells. 

In addition to the noise introduced by the signal s, each internal node of 
the network (a, m and y) contributes to the output fluctuation due to the 
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intrinsic stochasticity of the intracellular biochemical reactions. The time- 
averaging picture (Eq. 3) is useful to characterize internal noises. As the read- 
out of the signal s by a is fast, ~ r y ^> r a , and the activity noise is heavily 
damped. The noise from the adaptation node m goes as ~ (1 + t^/t™) -1 , 
which is almost unfiltered since r m ^> r y in sensory systems. The noise from 
the output node is always unfiltered, as = r y . These two unfiltered in- 
ternal noise sources, which exist even in the absence of the external signal, 
constitute the noise floor of the signaling network. Their absolute and rel- 
ative strengths depend on the details of the system, and will be discussed 
later in the case of E. coli chemotaxis. 

So far we have focused on the network of Fig. 1 A, which is an abstraction 
of the E. coli chemotaxis pathway (Fig. IB). We now proceed to extend our 
results to other adaptive topologies (Fig. 1C-F). It has recently been shown 
that the main three-node network topologies that can exhibit robust perfect 
adaptation are the one of chemotaxis shown in Fig. 1A, and that in Fig. 1C 
[14]. The topology in Fig. 1C is named Incoherent Feedforward Loop with a 
Proportioner Node (IFFLP) in [14]. For the chemotaxis topology, the condi- 
tion for accurate adaptation is simply / m , m = as shown before, whereas 
the IFFLP network requires a more stringent condition f y , m fm,a = fy,afm,m- 
If the perfect adaptation condition is satisfied by the IFFLP network, it is 
not hard to show that the transfer function has the same form as that of the 
chemotaxis topology. The only difference is that the adaptation and response 
rates for the IFFLP network are given by uj m = \fm,m\ and uj y — \f y , y \ respec- 
tively. Since the transfer function determines the signal filtering properties 
of the system, the two noise filtering strategies here described hold exactly 
for the alternative IFFLP topology. 

In general, any adaptive three-node topology that exhibits accurate adap- 
tation will do so by satisfying either the condition of the IFFLP network or 
that of the chemotaxis network [14]. For example the Yeast osmosensing and 
the olfactory adaptation topologies (Figs. 1D&E) have to satisfy the chemo- 
taxis condition (fm,m — 0) to exhibit accurate adaptation. On the other 
hand, the topology in Fig. IF exhibits accurate adaptation if it satisfies the 
IFFLP condition (f y ,mfm,a — fy,afm,m)- When any of these topologies sat- 
isfies the adequate condition and exhibits perfect adaptation, the transfer 
function has the form of the chemotaxis transfer function. As a consequence, 
the two noise filtering strategies found in this paper hold true for any three- 
node topology that exhibits accurate adaptation. 

3 E. coli chemotaxis: noise, filtering, and design trade-offs 

We now apply the general results of the previous section to the case of E. coli 
chemotaxis pathway, where the interaction functions and the noise strengths 
can determined based on the underlying biochemical reactions. In the follow- 
ing we present a simple model for bacterial chemotaxis following the recent 
work by Tu, Shimizu and Berg [13] before addressing the noise effects in the 
system. 

Over a wide range of ligand attractant concentration [L], the signal an 
E. coli cell senses depends logarithmically on [L]: s = ln([L] /!£/), with a 
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characteristic dissociation constant Kj (Kj w 18/iM for Me Asp as considered 
in this paper). The kinase activity of the chemoreceptor complex is given by 
a, and m is the methylation level of the chemoreceptor. The output y is 
the number of CheY-P molecules. A coarse-grained model of the chemotaxis 
pathway was proposed [13] and verified [16] with interaction functions given 
by: 

f a (a, m, s) = -u a (a - — ^ y ) (7) 

with uj a = 50Hz, and E(m,s) = N[a(m — mo) — 5] the free energy of a 
TV-receptors cluster with N = 6, a = 2, and mo = 1; 

/ m (a,m) =F(a) (8) 

has a root at ao = 1/3 and a negative slope which results in an adaptation 
time of r m = 10s; and 

f y (a, y) = kNa(y T - y) - uj z y (9) 

with M = 600 independent receptor units with a phosphate transfer rate 
k = 3 x 10 _3 Hz from CheA-P to the pool of yx = 10 4 CheY molecules, and 
a CheY-P decay rate assisted by the phosphatase CheZ of uj z = 1.3Hz which 
results in a response time of r y = 0.5s. 

The noise strengths can be obtained by summing the rates in the master 
equation underlying the Langevin dynamics [17]. For the activity switch- 
ing dynamics, the noise is binomial and its strength is given as (r] 2 ) = 
2a(l — a)(jj a /Af. For the methylation/demethylation processes, (77^) = 2a(l — 
a)F f (a)/N because the adaptation dynamics depends only on the activity. 
Since the fluctuation of the number of CheY-P molecules in a cell is due to 
an underlying Poisson process, we have (rjy) = 2yuj z . 

By using both the general analytical results from last section and direct 
simulations of the Langevin equation (Eq. (1)), we have studied the contribu- 
tions to CheY-P level fluctuation from different noise sources (external and 
internal). Different noise contributions and their dependence on the two key 
time scales of the system r m and r z are summarized in Figure 2. 

We first consider the high frequency noise from ligand binding and diffu- 
sion, which have been the focus of most previous works [1-4]. The signal noise 
rjd caused by the diffusion of ligand molecules around a unit of TV receptors of 
size I can be modeled [2,18]. It is not hard to show that the ligand diffusion 
noise r/d can be characterized by a strength (77^) ~ 4(27r) 5 / 2 /(r^[L](A^/) 3 ) 
and a correlation time w (Nl) 2 /D ~ 10 _5 s, where the ligand diffusion 
constant D w 10 _5 cm 2 /s is used for MeAsp, and I w 0.01/im is used for 
receptor Tar [1,19]). For E. coli chemo-receptors, the signal noise 775 can also 
be characterized by its strength (t? 2 ) « (1 — a)(iQ + [L]) 2 / (rbKi[L]) from 
the stochastic binding-unbinding process with an even shorter time scale 
75 « (DNl(Ki + [£])) -1 ~ 10 _7 s. According to our analysis, these high fre- 
quency noises are averaged over the response time t z , but not the adaptation 
time r m . These general predictions (solid lines in Fig. 2) are confirmed by 
direct simulations (symbols in Fig. 2) of the pathway dynamics (Eqs. 7-9). 
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As shown in Fig. 2A, the contribution to the output fluctuation from the 
ligand diffusion noise (light blue symbols and line) and ligand binding noise 
(purple symbols and line) decreases with r z \ while they are independent of 
r m as shown in Fig. 2B. Given that the averaging time is much longer than 
the ligand binding and diffusion times r y = 0.5s ^> t^, the effects of the 
ligand binding and diffusion noise are negligible in E. coli chemotaxis, orders 
of magnitude smaller than the internal noise floor (red symbols and lines in 
Fig. 3). Hence, these high frequency noises are unlikely the limiting factors 
for sensing accuracy in E. coli as usually assumed [4,12]. However, in other 
systems such as in eukaryotic chemotaxis, the binding time can be compa- 
rable to the response time T5 ~ r y [20,21], so the ligand binding-unbinding 
noise 775 can be significant. The ligand diffusion noise rjd can also be more 
relevant for systems with relatively large receptors, which lead to a longer 
correlation time of ligand diffusion noise. 

As we have shown above, the effect of the high frequency signal noise 
due to ligand binding and diffusion on the output fluctuation is negligible. 
The dominant source of signal noise is the low-frequency signal fluctuation 
that originates from the random motion of the cell in a ligand gradient. 
Here, we characterize this previously unstudied signal noise. In an exponential 
attractant gradient [L] = [L]oe rx , a cell moves in a biased random walk with 
a constant drift velocity plus a random-walk velocity rj v with correlation 
time r v , variance a 2 and the spectrum (rj%(u))) = 2co v a 2 /(uj 2 + uj 2 ) [22-24]. 
The random displacement (position) rj x = J rj v dt of the cell due to its random 
walk leads to a signal fluctuation r] rw = rrj x , which diverges as r] rw ~ uo~ l 
at low frequency uj — » 0. This strong signal fluctuation at low frequency is 
attenuated by the transfer function which goes as x ~ ^ at a; ^ due to 
adaptation's additional role as a low frequency controller. As a result, the 
random- walk induced output variance remains finite: 

°Yrw = Wy(l ~ a)] 2 (rcj v r v ) 2 x ^. (10) 

r v 

The adaptive control of the random-walk induced signal noise is evident from 
the above expression. In Eq. 10, (ra v r v ) 2 is the signal variance during one 
random- walk step. The variance of the signal increases linearly with time 
~ t/r v due to the random- walk nature of the cell motion. For t > r m , the 
increase in signal variation is stopped by the adaptation process, and the 
variation of the output saturates to be proportional to r m /r v . 

Direct simulations of Eq. 1 using the pathway interactions (Eqs. 7-9) 
and random-walk induced signal noise confirm this analysis. As shown in in 
Fig. 2A&B (blue symbols and lines), the effects of the random- walk induced 
noise are independent of r z , but increase with r m , exactly as predicted from 
Eq. (10). Depending on the ligand concentration gradient, the effects of this 
random- walk noise can be quite significant. For a exponential gradient r = 
1mm -1 , the drift velocity is Vd ~ 2/xm/s [23], and the cell velocity fluctuation 
can be estimated from a pathway-based simulation [24] a v w 9/xm/s and r v w 
0.5s. From Eq. (10), the resulting relative output fluctuation is 0~Y,rw/y ~ 
10 -1 , which is much larger than the ligand binding and diffusion noise (see 
Fig. 2A&B), and comparable to the internal noise (see Fig. 3). The cell's 



9 



rotational diffusion also contributes to this noise. However, this contribution 
[12,25] is relatively small because the rotational diffusion time r r d ~ 10s is 
much longer than r v « 0.5s. 

The internal noises have been analyzed quantitatively for E. coli chemo- 
taxis to compare with the signal noise (Fig. 3). Both internal noise filtering 
processes, adaptation (node m) and output degradation (node y), contribute 
significantly to the total intrinsic noise. The adaptation process causes a 
larger output fluctuation cry^/y ~ 10 _1 , because its timescale is much 
longer than the response time r m ^> r y . Note that a low-frequency noise 
of this magnitude is required to explain the observed 1/f noise in the switch- 
ing dynamics [26,27]. It was shown in [27] that increasing the amount of 
the methyltransferase CheR reduces the output noise. This observation was 
explained in [28] by the possible ultra-sensitive dependence of kinase activity 
a on CheR, which in our model translates to a change in the prefactor C m 
of the adaptation induced noise. However, our study reveals an additional 
mechanism: increasing CheR reduces the adaptation time r m , and therefore 
the noise is averaged by r y more effectively as shown in Fig. 3B. The other 
main intrinsic noise source is the output node y, and its contribution to ay 
is smaller oy^jy ~ 10 -2 . Since the underlying molecular process is CheY-P 
de-phosphorylation, this intrinsic noise is a Poisson-type noise, its strength 
only depends on the number of molecules (CheY-P level). This analytical re- 
sult, as seen in Fig. 3 A, is consistent with the experimental observation that 
over-expressing CheZ and CheY together keeps the output variance constant 
[29]. 

The topology of a biological network and the choices of the key biochem- 
ical constants determine its functions. For the chemotaxis network, different 
functions can be identified in different frequency regimes of the transfer func- 
tion x(^) as shown in Fig. 4 A. At low frequencies (uj < uo m ) random- walk 
noise is controlled and the gradient of the signal is computed (see [13, 16]). At 
very high frequencies (uj > uj y ) ligand diffusion and binding noise are aver- 
aged out. With u m <C uj yi there is also an intermediate region uj y < uo < (ju m , 
wherein the responses to external signal are kept fast and strong as shown 
in Fig. 4B. The E. coli chemotaxis network may have evolved to optimize 
these critical functions in different frequency regimes. The general trade- 
offs of changing uj m and uj y become clear from our analysis. Reducing u m 
increases the sensitivity for gradient sensing since the CheY-P change in re- 
sponse to an exponential ligand gradient is ex cj" 1 [13,16]. But smaller uj m 
reduces the range of gradient sensing (see Fig. 4A, and [13,16]), and reduces 
the low-frequency noise control ability which is crucial for suppressing the 
random-walk induced noise. Reducing co y enhances the cell's ability in fil- 
tering high frequency noise. On the other hand, increasing uj y increases the 
response speed and response strength. As shown in Fig. 4B, the response 
(CheY-P level) to a step change in ligand concentration exhibits a peaked 
response Ayp at a time rp. The dependence of the peak response Ayp and 
the peak time rp on the output degradation rate uj y can be analytically de- 
rived, and are plotted in the inset of Fig. 4B. As one can see, increasing uo y 
reduces the peak time and increases the peak height. 
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4 Conclusions and Discussions 

That noise can be a limiting factor for the correct behavior of a cell is an idea 
that dates back to Berg & Purcell[l], who first proposed the time- averaging 
mechanism to reduce the effect of ligand diffusion noise in receptors. Their 
work has recently been extended and made more rigorous by several groups 
[2,5,3]. However, the exact molecular nature of the time- averaging mecha- 
nism remained unclear. Here, by studying the dynamics of a typical adaptive 
signaling network, we show unambiguously that the time- aver aging mecha- 
nism for the high frequency ligand binding and diffusion noise is the output 
decay process, not the receptor adaptation as previously suggested [4, 12]. 
This result is common to all adaptive sensory systems, independent of the 
network topology. 

For the particular case of E. coli chemotaxis, various aspects of noise in 
the signaling pathway have been studied in recent studies [4, 30]. We discuss 
some of these works in light of our findings in this paper. In [30], a signal-to- 
noise ratio study was carried out, with the "signal" taken to be the response 
to a white noise [31]. This unrealistic assumption of the signal leads to the 
conclusion that information was best encoded at very high frequencies [30]. 
However, it is well known that the chemotaxis pathway enables cells to de- 
tect deterministic changes (e.g., gradients) in chemo-effector concentration 
instead of random signals. As shown in this paper, the useful information re- 
sides at low (for ligand gradients) and intermediate (for ligand step change) 
frequencies (Fig. 4A). The noises caused by ligand binding and diffusion do 
have high frequencies, but they do not contain any useful information and 
are filtered out effectively by the Purcell-Berg time- aver aging mechanism. In 
another recent work [4] , a linear ligand gradient was considered as the input 
signal. However, this study claimed that the adaptation time is the noise- 
averaging time, probably because it considered the unrealistic case of having 
response time and adaptation time being the same. Moreover, although a 
linear ligand gradient was considered in [4], it did not identify the signal 
noise from the random- walk of the cell in a ligand gradient. As shown here 
in this paper, the randomness of in E. coli motion is in fact the main source 
of signal noise in a ligand gradient, while the signal noises caused by ligand 
diffusion and ligand binding considered before [3,4,12] are much smaller in 
comparison (Fig. 2). This dominant random- walk induced signal noise has a 
divergent low-frequency spectrum, which is fundamentally different from the 
simple white noise considered in previous studies [4,31]. We have shown that 
this previously un-characterized low-frequency noise is controlled by receptor 
adaptation. 

For all adaptive networks, the low frequency noise is controlled by adap- 
tation, while the high frequency noise is filtered by time- aver aging. The char- 
acteristics of these two noise filtering strategies are fundamentally different. 
Time averaging works better for longer response times (Fig. 2 A) , but adap- 
tive control works better for shorter adaptation times (Fig. 2B). However, 
the effectiveness in noise filtering, e.g., by reducing the adaptation time and 
increasing the response time, comes at the expense of the systems's ability to 
respond and sense. For instance, reducing the adaptation time gives a weaker 
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response for gradient-sensing [13], and increasing the response time gives a 
weaker and slower response to a step change in input. These tradeoffs, partly 
identified in previous works [12], are balanced in bacterial chemotaxis so 
that all the desired functionalities of the pathway come into play in different 
frequency domains as shown in Fig. 4 A. At low frequencies uj < uj m , adap- 
tation allows gradient sensing and is also crucial in controlling the divergent 
random-walk induced signal noise. The speed and strength of step responses 
remains optimum for a range of intermediate frequencies (uj m < uj < uj v ). 
The high frequency (uj > uj y ) noise, such as the ligand binding and diffusion 
noise, are heavily suppressed by the Berg-Purcell time- averaging mechanism 
through output degradation. 
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Fig. 1 Adaptive signaling networks capable of accurate adaptation: A. An illustra- 
tion of a 3-nodes network capable of achieving perfect adaptation to step changes 
in the external signal s (red circle) . The signaling nodes (blue circles) are the read- 
out a, the memory m and the output node y. This is an abstraction of the E. coli 
chemotaxis pathway. B. Signal transduction pathway for chemotaxis in E. coli. 
C-F. Different topologies which can achieve accurate adaptation: C. Integrative 
Feed-Forward Loop with a Proportioner node (IFFLP) topology, identified in [14] 
as the main alternative network to the chemotaxis topology in Fig. 1A, all other 
topologies are a composite of Fig. 1A and Fig. 1C. D. Topology of the olfactory 
sensing pathway in mammalian neurons. E. Topology identified in [?] for yeast os- 
motic shock response. F. Adaptive topology that exhibits two negative feedbacks 
couple to the same memory. 
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Fig. 2 Dependence of the three sources of signal noise on the output decay time 
(t z ) and the adaptation time (r m ). Results from direct simulations of Eq. 1 (sym- 
bols) and linear analysis (lines) are shown (see Eqs. 7, 8 & 9 for interactions and 
text for parameters used). Arrows indicate wild- type values of r z or r m ). The de- 
pendence of ligand binding noise (purple), ligand diffusion noise (light blue), and 
random- walk noise (dark blue) on A. r z and B. r m . The ligand binding and diffu- 
sion noise drop much more than random walk noise when r z increases, while random 
walk noise drops much more than ligand diffusion noise when r m decreases. Because 
of their very short timescales, the effects of ligand binding and diffusion noise are 
much smaller than that of the random- walk noise, which is the dominant source of 
signal noise. 
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Fig. 3 Dependence of the total signal noise and the total internal noise on decay 
and adaptation times. The dependence of the total internal noise floor (red) and 
the total signal noise (black) on A. r z and B. r m . Signal noise is comparable 
to internal noise. At low r m ~ r z adaptation noise starts being reduced by time 
averaging and the internal noise drops. Deviations between simulations (symbols) 
and linear analysis (lines) come from strong nonlinear effects when r z /r y ^> 1. 
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Fig. 4 The transfer function and response characteristics of adaptive networks. 
A. Three regimes can be identified in the transfer function (solid line) for E. coli 
chemotaxis: gradient sensing and adaptive noise control is performed at low frequen- 
cies (uj < ujm), response amplitude is strong for higher frequencies (cj m < uj < uj y ), 
and inputs with very high frequencies (uj > uj y ) are time averaged (axes arrows 
indicate wild-type values of uo y and cj m ). B. Output response \Ay\ to a small step 
change in the input. For fast response uo y = 20cj m as in E. coli chemotaxis, the re- 
sponse is fast and strong (solid line). For slow response uo y — 2u m as in eukaryotic 
chemotaxis, the response is slower and weaker (dot-dashed line). Inset. Depen- 
dence of the peaking time rp (dotted line) and peak height |A/p| (dashed line) on 
uj y . For E. coli wild- type value (axes arrow), both are near saturation. 



